Proceedings of the 10th Workshop on Quantum Solar Energy Conversion - (QUANTSOL'98)
March 8-14, 1998, Bad Hofgastein, Austria


In Itinere and Ex-Post Evaluation on Quantum Solar Energy Conversion Researches

S. Guarna

ENEA (Italian National Agency for New Technology, Energy and the Environment)
Lungotevere Thaon di Revel, n.76 - 00196 Rome - ITALY

Research and development activities must provide results of practical utility and contribute towards the social and economic development to ensure that the resources allocated are being used effectively and channeled in the appropriate directions.
Therefore, in International Organisation as UNESCO, OECD, European Union, NORDFORSK as well as at National level (Germany, Japan, Netherlands, United States ...) it is becoming more and more important to have a system for eveluating the results of Research and Development programmes.
Actually, the on-going and retrospective assessment ( or in itinere and ex-post evaluation) of Research and Development projects/programmes in order to evaluate the contribution of the results to the economic, social and scientific growth, play an important role in the development of national and international research policies.
The main tools available to track and monitor research and development projects and activities are: PERSONNEL, EXPENDITURES, FACILITIES, BIBLIOMETRICS, TECHNICAL REVIEW and SURVEY.
A wide variety of personnel is needed in the R & D effort: from the Nobel prize-winner to the winner s secretary, from the designer of space experiments to the breeder of laboratory animals. Because of the range of skills and education required, it is essential to classify R & D personnel into categories. For example, all those employed as researchers would have university degrees and that all university graduates working on R & D would be employed as researchers.
R & D is an activity for which there are significant transfer of resources among units, organisations and sectors. It is important for science policy advisors and analysts to know who finances R & D and who performs it. The main disavantage of R & D input series expressed in monetary terms is that they are effected by differences in price levels between countries and over time; then it is recommended the use of purchasing power parities (PPP).
Standardised equipment, library facilities, laboratory space, journal subscriptions and standardised computer time would all be possible measures.
Bibliometrics is the technical name for a range of analytical methods using published materials (books, reports, patents, software, designs, prototype and blueprints) to develop descriptive statistics, multidimensional analyses and graphical representations of the output of science.
Technical or expert review is the most widely used approach in research evalutation around the world. Among countries and among different organisations, technical review varies from very informal assessment process to highly structured retrospective quality control mechanisms.
Traditional survey methods, either on paper, in person or by phone, where a group of participants or stakeholders are asked to provide responses to a set of questions, are often used to assess the benefits or outcomes of research.
According to thies scenario and utilising some standard indicators, at the next 10th Workshop on QUANTSOL 98, experts from a wide spectrum of experimental, theoretical and applied disciplines on quantum solar energy conversion (photovoltaics, photoelectrochemistry, photochemistry, etc.) will have the possibility to provide a valuable input in the programme revision, to form a sound basis for future proposals for an evalutation system and, at the same time, to constitute a stimulus to the general development of evalutation activities within our scientific community.
The final step of the proposed peer review should be a number of pratical recommendations for subsequent researches on Quantum solar Energy Conversion in the next years.


[BACK] [MAIN] [FURTHER]


Last updated June 11, 1998